Synchronization, Diversity, and Topology of Networks of Integrate and Fire 

Oscillators. 
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We study synchronization dynamics of a population of 
pulse-coupled oscillators. In particular, we focus our atten- 
tion in the interplay between networks topological disorder 
and its synchronization features. Firstly, we analyze synchro- 
nization time T in random networks, and find a scaling law 
which relates T to networks connectivity. Then, we carry on 
comparing synchronization time for several other topological 
configurations, characterized by a different degree of random- 
ness. The analysis shows that regular lattices perform better 
than any other disordered network. The fact can be under- 
stood by considering the variability in the number of links 
between two adjacent neighbors. This phenomenon is equiv- 
alent to have a non-random topology with a distribution of 
interactions and it can be removed by an adequate local nor- 
malization of the couplings. 
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I. INTRODUCTION 

Synchronization of populations of interacting oscilla- 
tory units takes place in several physical, chemical, bi- 
ological and even social systems Networks of in- 
teracting oscillators are currently used to modelize these 
phenomena. In this paper we will focus on a special kind 
of interacting oscillators, namely pulse coupled oscilla- 
tors. These units oscillate periodically in time and inter- 
act, each time they complete an oscillation, with its cou- 
pled neighbors sending them pulses which modify their 
current states. These systems show a rich spectrum of 
possible behaviors which ranges from global synchroniza- 
tion [Q or spatio-temporal pattern formation to self- 
organized criticality 0. Although some theoretical ap- 
proaches have been proposed, in general, the singular na- 
ture of pulse-like interactions does not allow to describe 
the system in terms of tractable differential equations. 
Despite this, some methods have been developed to find 
the attractors of the dynamics and study their relative 
stability g|II]. 

In this paper, we want to focus on the effects that dif- 
ferent topologies have on the dynamical properties of the 
network. In particular, we will study how does network's 
topology affect global synchronization. So far, most of 
the studies on networks of coupled oscillators have been 
done on cither small connectivity lattices (usually ID 



rings) 



works of continuously coupled oscillators (Kuramoto's) 
§ HI and Hodgkin-Huxley neuron-like models |L2] where 
different non-standard topologies are considered. Among 
these, the so-called Small-world networks seem to be an 
optimal arquitecture, in terms of activity coherence, for 
some of these coupled systems 

Pulse coupled oscillators are commonly used to mod- 
elize driven biological units such as pacemaker cells of 
the heart Jl4| and some types of neurons Jig] . In these 
systems, synchronization is usually considered to be a 
relevant state. Regarding heart, pacemakers must be 
synchronized in order to give the correct heart rhythm 
avoiding arrhythmias or other perturbed states. In pop- 
ulations of neurons, synchronization has been experimen- 
tally reported jl6| and is believed to play a role in infor- 
mation codification p7| . Therefore, it is interesting to 
check which kind of topologies makes the network reach 
a coherent state more easily and uncover why is it so by 
looking for its responsible mechanisms. We will focus in a 
whole family of networks which are characterized by its 
increasing degree of disorder, i.e. ranging from regular 
lattices to completely random networks. 

The structure of this paper is the following. In Sec. 

II we introduce the model of pulse-coupled oscillators 
which is going to be used throughout the paper. In Sec. 

III we start studying synchronization of populations of 
these coupled oscillators in random networks. In Sec. 

IV we compare random network performance with the 
more classical regular lattices. In Sec. V we consider 
a more general family of networks with a variable de- 
gree of randomness and study its synchronization prop- 
erties. Moreover, the interplay between diversity, inter- 
action and topology is also discussed. In the final Section 
we present our conclusions. 



II. BASICS 

We study the synchronization of a network of N oscil- 
lators interacting via pulses. The phase of each oscillator 
<j>i evolves linearly in time 



dt 



1 



V* = 1, 



,N 
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or globally coupled networks (all to all cou- 



until one of them reaches the threshold value <f) t h = 1- 
When this happens the oscillator fires and changes the 
state of all its vicinity according to 



pling) [4|. Nevertheless, there is some work done in net- 
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FIG. 1. Typical evolution of m. The activity coherence 
of the system increases with time. At time T the population 
reaches global synchronization (m(t = T) = 1). In this ex- 
ample, we consider a population of TV = 300 oscillators with 
arbitrary initial conditions (m(t — 0) ~ 0.5). 

where j C T(i), T(i) being the list of nearest neigh- 
bors of oscillator i. The nonlinear interaction is in- 
troduced in the Phase Response Curve (PRC) A (</>). 
We use a PRC which induces a global synchronization 
(4>i = 4>2 = ••• = 4>n) of the population of oscillators: 
A(0) = £(j> with e > . This PRC is, indeed, the most 
simple type of interaction that always leads to a synchro- 
nizated state whatever the initial conditions are. In other 
words, synchronization is the unique attractor of the dy- 
namics. Altough it has only been mathematically proved 
for all-to-all Q and local || couplings, for all the topolo- 
gies we have dealt with, synchronization holds. Therefore 
the dynamics could also be expressed as 



dt 



1 



icr(i) 



5{t-t 3 ), 



(2) 



where tj are the firing times of <pj. To define a certain 
degree of synchronization in our simulations, we define 
the variable 



1 N 

-Fa 



(3) 



measured each time (/)% = 0. The choice of oscillator 1 
as a reference is completely arbitrary. Notice that mea- 
suring the phases at ensures that these phases are if 
they are synchronized with oscillator 1, not depending on 
the order they fire. In this way, we have a series of sys- 
tem "snap-shots" which mathematically correspond to a 
return map of the dynamics (see Fig. 1). Synchroniza- 
tion time T is thus defined as the time needed to reach 
m = 1. When this happens, all oscillators will always fire 
in unison. 



III. RANDOM NETWORKS 

We start studying synchronization of a population of 
coupled oscillators by defining a Random Network (RN) . 



We restrict ourselves to the most simple type of RN [[L9| , 
that is, we randomly select a pair of the N nodes and es- 
tablish a link among them, repeating this procedure up to 
a certain number of links I. Notice that, with this wiring 
method, there is no guarantee of ending up with a con- 
nected network (where there must be a path connecting 
any pair of nodes). Dealing with a network splitted into 
two or more clusters would make global synchronization 
(m = 1) impossible so we should avoid such pathologi- 
cal configurations. In order to have a connected network 
one has to work over a threshold number of links which 
ensures connectivity pOfl 



N 

Z»__ln(/V). 



(4) 



Therefore we can study RN whose number of links I runs 
from the above limit up to the globally connected net- 
work (all to all coupling) which has I = N(N — l)/2. In 
addition, if we want to study the transient to synchro- 
nization, one should always stay in the limit 



Ne <C 1, 



(5) 



otherwise synchronization would be achieved in a few fir- 
ings due to the stronger interaction. 

As one expects, when the number of links / is increased, 
the time needed to reach synchronization T diminishes, 
having its lowest value for the globally connected case. 
What is really interesting is how does T decrease as we 
consider networks with more links. It turns out that T 
follows a power-law with a slope which is independent of 
the number of nodes. 

t ~ r a VAT, (6) 

with a = 1.30 ± 0.05 for e = 0.01. In Fig. 2 this behav- 
ior is shown. In these simulation results, each point is 
averaged over different random topologies with the same 
number of links and over different initial arbitrary con- 
ditions for all the oscillators. 

In addition, one can study how does T increase with 
the number of oscillators N. We find that it also follows 
a power-law behaviour which does not depend on the 
number of links I considered 

Nf> 



T 



V/, 



(7) 



with P = 1.50 ± 0.05 for e = 0.01. Therefore, once the 
interaction strength is set, we can characterize synchro- 
nization time T by means of network's geometrical prop- 
erties trough the scaling relation 

AT/? 

(8) 



T 

which can be rewritten as 
T 



I 

iV2 



(9) 



In Fig. 3 we plot the collapse of data curves according to 
Eq. 9 and the agreement is excellent. The exponents a 
and p are constant within the error bars for the checked 
values of e (0.1 > e > 0.005). 
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FIG. 2. T as a function of I for a fixed number of oscilla- 
tors N and fixed interaction strength e = 0.01. Results are 
averaged over 100 different arbitrary initial conditions in 10 
different random topologies. The lowest value of I is in each 
case the one which statistically guarantees that the network 
is connected and the highest one is all-to-all coupling. For 
higher values of N the power-law behavior is lost since rela- 
tion (3) does not hold anymore. 
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FIG. 3. Collapse of data curves T(l, N) supporting the scal- 
ing hypothesis T ~ N 9 r a for e = 0.01. 
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FIG. 4. T as a function of I with a fixed number of oscil- 
lators N = 100 and interaction strength e = 0.01 for the two 
kind of extreme networks RL and RN. RL always performs 
better than RN although its difference quickly vanishes as we 
tend to a globally coupled network. 



IV. RANDOM NETWORKS VERSUS REGULAR 
LATTICES 

Once we have seen the synchronization features of RN, 
it would be interesting to compare them with the per- 
formance of Regular Lattices (RL). In the ID RL we 
consider, each oscillator is coupled to its 21 /N nearest- 
neighbors in a ring-like (ID reticle with periodic bound- 
ary conditions) network. In Fig. 5 there is an example 
of RL with 21 /N = 4. In order to do the comparison we 
must calculate T for the RL, always keeping the same 
number of nodes and links as in the RN cases. Since the 
RL is the topological configuration which is a connected 
network with a minimum number of links (I = N) we can 
also explore topologies with fewer links than the RN. 

Another point one has to take into account when 
studying RL with a growing number of links I is that 
it is not possible to add just one link to pass from one 
configuration to another since it would break the regular- 
ity of the lattice. Instead, one has to work with integer 
values of 21 /N, that is, adding a next nearest neighbor 
to all oscillators when passing from one configuration to 
the next one that have more links. Therefore, altough we 
can start from an initial minimal configuration with less 
links, we have less points to study. 

In Fig. 4 results for e = 0.01 are shown. One can 
clearly see that the RL performs better than the RN 
for all degrees of connectivity. This result holds for all 
e > 0. Nevertheless, this difference is only appreciable for 
lower values of I so that as our network has more links 
it quickly vanishes. When we are close to the globally 
connected network, the synchronization features of both 
kind of networks are roughly the same, while in the low 
connectivity case, the RN has synchronization time T 
much longer (about twice) than the RL. 
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FIG. 5. Randomization procedure for an initial RL with 
links to first and second nearest neighbors. Each links is cut 
with a probability p — 0.3 and re- wired between two randomly 
selected pair of nodes (dashed lines) . For p = 0we have again 
the RL since no link is re-wired while for p = 1 the pure RN 
is recovered. 



V. MIXED TOPOLOGIES 

So far, we have checked the synchronization features 
of the two extreme kind of networks: RN and the RL. 
Nevertheless, there exists a whole family of networks 
that lie between these two limits. They are networks 
of mixed nature, that is, although they may have some 
random connections, also posses an underlying regular 
structure. Recently, this kind of networks have received 
a lot of attention OJl3| , p2| , specially due to to the so- 
called Small-world networks. These networks, basically 
a regular lattice with a very small amount of random 
connections, have the advantage of having a low average 
distance among nodes while keeping a highly clustered 
structure. In this work, we examine synchronization time 
for networks with all degree of randomness ranging from 
the RL to RN. 

We parametrically characterize these networks with a 
re-wiring probability per link p. It defines the following 
randomization procedure: starting from an initial RL of 
/ links, we cut each link with probability p and re-wire 
it between two randomly chosen pair of nodes. Notice 
that our method slightly differs from other used by some 
authors who just rewire one edge of the link [is] ] or add 
new ones pl| . In this way, we keep the number of links I 
constant and recover the previous two limiting cases, the 
RN and the RL, for p = 1 and p = respectively (see 
Fig. 5). 

In Fig. 6 we see the synchronization time T for a net- 
work of N — 300 oscillators with 21 /N = 16. One can 
clearly see that T grows monotonously as we introduce 
more disorder into the system (increasing p) . For differ- 
ent N and I the behavior of T is qualitatively the same. 

These results obviously raise a question: why does 
topological disorder slow the synchronization process?. 
The re-wiring process induces a random distribution of 
links for any oscillator. Therefore, two adjacent units can 
have a very different number of oscillators. This fact is 
crucial since the incoming signal from the firings of the 
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FIG. 6. Synchronization Time T for the whole range of 
re-wiring probability p. Each point is averaged over 1000 re- 
alizations for a system of N = 300 oscillators and 21 /N = 16. 
T increases monotonously with p as the dispersion in the num- 
ber of links also does. This figure can be thought as a cross 
section of Fig. 4, with an extra p-axe. Empty circles cor- 
respond to the normal case. Filled squares show the results 
once the interactions have been normalized according to Eq. 

neighborhood of a given oscillator can be much larger 
or smaller than the signal that another of its neighbors 
receive. In this case, the two oscillators have different 
effective frequencies. The larger the difference in their ef- 
fective driving, the more difficult is to synchronize these 
two units. This can be thought as a kind of dynamic 
frustation among two adjacent oscillators. One way of 
quantifying this problem is to check the variability in 
the number of neighbours per oscillator. In Fig. 7 we 
can see how does the dispersion in the number of links 
per node grow as we induce more topological disorder. 
This dispersion a 2 is zero for p = (RL) whereas for a 
p = 1 (RN) the distribution of links is known to follow a 
Poisson distribution with a variance equal to 21 /N when 
N — > oo ]l9| . As we can see, both Fig. 6 and 7 look 
quite similar, they show a monotonic growth with the 
re- wiring probability p wich seem to saturate for values 
close to 1. 

Another way to check if, in the topologically disor- 
dered model, this dynamic frustation is the responsible 
for the delay to synchronization is trying to remove it. 
This can be done if we think in terms of effective driv- 
ings, once we have seen that topological disorder induces 
an heterogeneity in these drivings, we can try to make 
them homogeneous again by means of a convenient lo- 
cal interaction normalization. The normalization works 
as follows, without changing the topology, each oscillator 
modifies all pulses it receives from the firing of any of its 
neighbors by the factor 



< N(T(i)) > 
N(T(i)) ' 



(10) 
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FIG. 7. Dispersion (a 2 ) in the number of links for the whole 
range of p. Each point corresponds to an average of 1000 re- 
alizations for a system of N = 300 oscillators and 21/N — 16. 
For p = 1 the system has a complete Random Network topol- 
ogy and thus is expected to have a a 2 ~ l/N (Poisson Ap- 
proximation). Dashed line corresponds to this limit behavior 

where N(T(i)) is the number of neighbors of (pi. This 
normalization means that the more pulses an oscillator 
receives, the less intense they are. The average number of 
neighbours < N(T(i)) > is always 21/N for all p. In Fig. 
6 we see that this procedure does remove the dynamical 
frustation, lowering the time needed to achieve synchro- 
nization, and even making it shorter than the unnormal- 
ized case for some small values of p. Therefore, with this 
rough method we are able to get rid of the effect that 
topological disorder had on the synchronization features 
of the network. 

From another point of view, one can think of this vari- 
ability induced by the topological disorder as something 
equivalent to have some diversity in a population of cou- 
pled oscillators on a RL. Imagine that, for instance, a 
population of oscillators following the dynamics: 

^ = l + e y ]T 5{t-tj), (11) 
icr(t) 

with iij being a random variable uniformly distributed 
over the interval (e — s, e + s). In this case, s gives us 
a quantitative idea of the population diversity. Now, in 
this modified model, synchronization time T also grows 
as we increase population diversity s. In Fig. 8 we can 
check this for a population of N = 100 oscillators in a 
RL with 21/N = 16 and a mean value of the interaction 
< >= 0.01. The same result, for the specific case 
of all-to-all coupling had already been found out in Q . 
Therefore, for this kind of pulse-coupled oscillatory sys- 
tems, inducing some topological disorder is almost equiv- 
alent to deal with a random distribution of interactions 
in a regular lattice as far as synchronization features are 
concerned. 
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FIG. 8. Synchronization Time T for a population of 
N — 100 oscillators in a RL with 21/N — 16 with an in- 
homogeneous distribution of interactions iij characterized 
by its dispersion s. Increasing dispersion in this distribu- 
tion makes synchronization process more difficult, increas- 
ing T. Results are averaged over different realizations of the 
quenched random interactions and arbitrary initial conditions 
with < >= 0.01. 

VI. CONCLUSIONS 

In this paper we have studied synchronization time T 
for several networks, each of them characterized by a dif- 
ferent degree of randomness. For the special case of a 
completely random network we have found out a scaling 
relation between T and network's connectivity T(N,l). 
As far as other topologies are concerned, the regular lat- 
tice is the one which synchronizes faster. Nevertheless, 
our regular lattice is a Id ring-like structure, and there 
are other kind of regular lattices which might also be 
studied (2d lattices, hierarchical trees,...). Therefore the 
question of which is the optimal synchronizing network 
remains open. However, the main aim of our work was 
to point out which are the geometrical mechanisms re- 
sponsible for slowing or accelerating the synchronization 
process in such pulse-coupled systems. It turns out that 
the variability in the number of neighbors is a factor that 
slows synchronization. We have finally proposed a local 
normalization method that manages to remove the effects 
induced by the topological disorder. Among the limita- 
tions of our model there is the lack of time delays in the 
interaction, or a finite pulse propagation velocity, which 
are present in real systems. Such effects might modify 
some of the results and is part of future work. 
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